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Abstract 


•H 

Several  proposed  routing  algorithms  for  store  and  forward  communication 
networks,  including  one  currently  under  implementation  in  the  ARPANET,  route 
messages  along  shortest  paths  computed  by  using  some  set  of  link  lengths. 

When  these  lengths  depend  on  current  traffic  conditions  as  they  must  in  an 
adaptive  algorithm,  dynamic  behavior  questions  such  as  stability,  convergence, 
and  speed  of  convergence  are  of  interest.  This  paper  is  the  first  attempt 
to  analyze  systematically  these  issues.  It  is  shown  that  minimum  queuing 
delay  path  algorithms  tend  to  exhibit  violent  oscillatory  behavior  in  the 
absence  of  a damping  mechanism.  Several  easily  implementable  damping  schemes 
are  proposed  and  analyzed  by  using  nonlinear  stability  theory  techniques. 


2 


1.  Introduction 

A central  operational  problem  of  a communication  network  involves  the 
choice  of  routes  used  by  messages  to  travel  from  origin  to  destination.  It 
is  possible,  of  course,  to  choose  a fixed  route  for  each  origin-destination 
pair,  but  this  precludes  the  possibility  of  adjusting  routes  to  alleviate 
congestion  due  to  statistical  variations  in  traffic  conditions.  For  this 
reason  attention  has  focused  on  adaptive  routing  strategies 
whereby  congestion  in  the  network  is  continuously  monitored  and  routes  between 
origin-destination  pairs  are  modified  in  real  time  so  as  to  keep  average 
delay  per  message  at  a reasonable  level.  A routing  scheme  of  this  type  was 
implemented  in  the  ARPANET  in  1969  and  attracted  considerable  attention. 

The  main  idea  in  this  scheme  is  to  compute  in  real  time  an  estimate  of  the 
minimum  average  delay  per  message  for  each  origin-destination  pair  and  to 
route  messages  along  the  current  minimum  estimated  delay  path.  When  this 
scheme  was  first  implemented,  it  was  noticed  that  it  is 
prone  to  severe  oscillations.  This  behaviour  is  due  to  the  fact  that 
delay  estimates  used  to  choose  routes  are  themselves  affected  by  the  route 
choice  with  a feedback  effect  resulting.  To  remedy  this  situation  it  was 
decided  on  heuristic  grounds  to  introduce  an  additive  factor,  called  bias, 
to  the  estimated  delay  of  each  link,  thereby  building  into  the  algorithm 
a preference  towards  paths  with  small  number  of  hops  to  the  destination 
[5]  - [7] . This  had  a stabilizing  effect  albeit  at  the  expense  of  considerable 
loss  of  sensitivity  to  traffic  congestion. 

The  implementation  of  the  minimum  delay  path  idea  in  the  original 
ARPANET  algorithm  had  a number  of  flaws  allowing,  for  example,  the  formation 
of  loops.  For  this  reason  alternative  schemes  based  on  the  same  idea  were 
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studied,  a new  algorithm  called  SPF  has  been  developed  and  is  now  ready  for 
implementation  [1] , [4] , [11] . The  present  paper  is  an  outgrowth  of  the 
author's  participation  in  the  design  study  of  this  algorithm  during  the  summer 
of  1978  at  BBN,  Inc.  However,  our  analysis  does  not  focus  on  the  ARPANET 
and  the  SPF  algorithm  in  particular,  but  rather  is  geared  towards  understanding 
the  effect  of  feedback  and  the  nature  of  the  dynamic  behaviour  of  shortest 
path  algorithms  where  link  lengths  depend  on  current  traffic  conditions. 

We  note  that  the  algorithms  of  this  paper  ate  far  from  optimal  since  they 
are  single  path  algorithms  in  the  sense  that  at  any  given  time  there  is  only 
one  path  per  origin-destination  pair  along  which  messages  can  travel.  Better 
performance  can  be  achieved  by  allowing  multiple  paths  as  for  example  in  the 
optimization  algorithm  of  Gallager  [9]  or  its  second  derivative  versions  [2J  . 

On  the  other  hand  the  hardware  limitations  of  some  of  the  presently  existing 
networks  including  the  ARPANET  preclude  the  use  of  such  more  sophisticated 
algorithms.  Furthermore,  we  feel  that  the  mere  fact  that  the  algorithm  has 
been  successfully  implemented  in  a network  as  interesting  and  influential 
as  the  ARPANET  makes  it  worthy  of  analysis  and  investigation.  This  is 
reinforced  by  the  fact  that  the  behavior  exhibited  by  the  algorithm  is 
quite  interesting  and  cam  pose  nontrivial  design  problems. 

The  paper  is  organized  as  follows t 

In  Section  2 we  provide  a deterministic  finite  state  Markov  chain 
framework  for  studying  a simple  version  of  the  algorithm.  We  show  that  for 
ring  networks  the  algorithm  may  tend  to  oscillate  between  poor  routing  paths 
and  become  itself  a major  contributor  to  congestion.  We  also  demonstrate 
how  the  use  of  a bias  factor  can  provide  a mechanism  for  damping  oscillations 


as  confirmed  by  experience  with  the  original  ARPANET  algorithm. 
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The  finite  state  model  does  not  lend  itself  to  analysis  of  more  sophisticated 
routing  schemes  and  more  general  network  topologies.  We  consequently  introduce 
in  Section  3 a model  of  a ring  network  with  a continuum  of  nodes  and  a single 
destination.  This  allows  us  to  employ  techniques  of  stability  analysis  of 
discrete-time  systems  with  continuous  state  space,  and  enables  us  to  further 
quantify  the  relationship  between  choice  of  link  lengths  and  algorithmic 
behavior. 

The  analysis  of  Section  3 focuses  primarily  on  the  effect  of  using  a 
bias  factor  as  a damping  mechanism.  In  Section  4 we  show  that  oscillations 
can  also  be  damped  effectively  by  making  the  link  lengths  dependent  on 
several  preceding  routing  paths  via  some  averaging  mechanism  such  as  a fading 
memory  scheme  or  asynchronous  link  length  updating.  To  our  knowledge  the 
fact  that  averaging  can  provide  a damping  mechanism  in  a shortest  path  algorithm 
has  not  been  noticed  earlier  and  in  fact  when  we  originally  approached  this 
problem  at  BBN,  Inc.  there  was  considerable  concern  regarding  its  effect  on 
algorithmic  behavior.  It  is  now  believed  that  the  significant  degree  of 
averaging  inherently  present  in  the  SPF  algorithm  is  in  large  measure  responsible 
for  the  stable  dynamic  behavior  observed  in  experiments  conducted  thus  far 
HI]. 

The  analysis  of  Sections  2-4  focuses  on  ring  networks.  The  ring 
topology  is  central  for  the  extension  of  our  earlier  results  to  more  complex 
network  topologies.  This  extension  is  carried  out  in  Section  5 under  the 
assumption  that  an  equilibrium  routing  exists.  However,  by  contrast  with 
ring  networks,  an  equilibrium  routing  need  not  always  exist  for  more  complex 
topologies.  We  demonstrate  via  example  the  mechanism  by  which  such  a 
phenomenon  can  occur. 

The  results  and  analysis  of  the  present  paper  can  be  generalized  to 
the  case  where  there  are  more  than  one  destinations.  This  analysis  is 


straightforward  but  considerably  more  complex  technically  and  may  be  found  in  [3] . 
The  continuous  node  model  of  sections  3-5  may  be  criticized  on  the  grounds 
that  it  is  unrealistic.  On  the  other  hand  it  is  very  difficult  to  provide  an 
extensive  analysis  of  a more  realistic  finite  node  network  model.  In  particular, 
it  appears  impossible  to  demonstrate  the  effect  of  averaging  in  such  a context. 
Furthermore  we  believe  that  the  realism  of  any  algorithmic  model  must  be  judged 
on  the  basis  of  the  validity  of  the  conclusions  it  provides  regarding  the 
behavior  of  the  related  practical  algorithm.  These  conclusions  in  our  case 
have  been  verified  by  extensive  numerical  experiments  with  finite  node  net- 
works 14] , [3] . In  particular  the  validity  of  our  qualitative  results 

regarding  the  role  of  a bias  factor  and  averaging  as  damping  mechanisms 
have  been  amply  demonstrated. 

2.  A Finite  State  Markov  Chain  Model 

Consider  a communication  network  with  nodes  denoted  by  1,2 , . . . ,N  and 
directed  links  denoted  by  (i,Z)  where  i is  the  head  node  and  l is  the  tail 
node,  we  consider  the  following  algorithm  for  periodically  updating  paths 
for  routing  messages. 

(A)  At  the  beginning  of  every  time  period  a nonegative  length  of 
every  link  (i , it)  becomes  availabe  to  each  node.  Based  on  these  lengths  each 
node  computes  a shortest  path  to  each  destination  and  routes  messages  over 
that  path  during  the  period. 

The  standing  assumption  for  algorithm  (A)  is  that  the  lengths  used 
in  computation  of  a new  shortest  path  depend  exclusively  on  one  or  more 
preceding  shortest  paths.  This  dependence  is  deterministic  via  a rule  that 
for  the  moment  we  leave  unspecified.  As  an  example 


may  represent  some 
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measure  of  average  delay  per  message  on  link  (i,l)  during  one  or  more  preceding 
periods  perhaps  with  an  added  bias  factor  -a  scheme  currently  implemented  in 
the  ARPANET  11] , 111] . By  assuming  that  the  dependence  of  on  previous 
shortest  paths  is  deterministic  we  also  implicitly  assume  that  the  input  traffic 
originating  at  each  node  is  a stationary  stochastic  process  whose  ensemble  para* 
meters  can  be  adequately  measured  by  time  averages.  This  assumption  is  not 
valid,  of  course,  in  practice  but  is  a reasonable  approximation  to  the  situation 
where  the  time  constant  of  traffic  statistic  variations  is  large  relative  to 
the  shortest  path  updating  period. 

Consider  first  algorithm  (A)  applied  to  a given  network  for  the  case  where 

the  lengths  depend  exclusively  on  the  preceding  shortest  path.  Assume 

also  that  the  shortest  path  algorithm  has  a fixed  rule  for  breaking  ties 

between  equidistant  paths.  Then  each  shortest  path  uniquely  determine  the 

next  shortest  path.  There  is  a finite  number  of  possible  shortest  paths 

(also  referred  to  as  routings)  which  we  denote  by  R^,  R^,....,^  where  M 

is  some  integer.  To  any  initial  routing  say  R^  , there  corresponds  a 

o 

unique  sequence  of  subsequent  routings  R.  , R.  ,...  Thus  eventually  some 

X1  *2 

routing  will  be  repeated  (say  R.  » R.  ) , and  once  this  happens  the  routing 

jc  k+n 

sequence  will  become  periodic.  Thus  starting  at  R^  the  algorithm  will 

o 

eventually  end  up  cycling  through  R.  , . . . R.  . Of  course  it  is  possible 

Tc  k+n-1 

that  R^  itself  is  part  of  the  cycle  (k»0) , and  that  the  cycle  consists  of 
o 

a single  routing  (n»l)  in  which  case  the  algorithm  stabilizes  at  that 
routing. 

The  model  just  described  is  one  of  a deterministric  finite  state  Markov 
chain  with  states  , . . .R^.  From  Markov  chain  theory  or  by  elementary 
reasoning  it  follows  that  the  set  of  all  routings  { R_ , . . • , R^}  can  be  parti- 


tioned  into  a collection  of  cycles  (or  ergodic  classes! , and  a collection  of 
transient  routings.  If  the  initial  routing  is  transient  it  is  never  repeated 
by  the  algorithm,  and  if  it  is  part  of  a cycle  the  algorithm  returns  to  it 
periodically.  More  than  one  cycles  may  exist.  Furthermore,  each  transient 
routing  leads  to  a unique  cycle. 

When  the  lengths  depend  on  a fixed  number  (say  m)  of  preceding  routings, 
a finite  state  model  for  the  algorithm  can  be  similarly  constructed  whereby 
the  state  space  of  the  model  is  the  set  of  all  m-tuples  of  routings.  Similarly 
the  state  space  can  be  partitioned  into  cycles  and  transient  states.  Analysis 
of  such  a model  is  naturally  more  difficult  in  view  of  the  increased  size 
of  the  state  space,'  and  this  is  more  so  if  depends  on  all  preceding 
routings  in  which  case  a countable  state  Markov  chain  model  is  necessary. 

In  what  follows  in  this  section  we  will  restrict  attention  to  the  case 
of  a ring  network  with  N nodes  shown  in  Figure  1.  Node  N is  the  only 
destination  and  all  links  are  bidirectional.  By  reversing  the  directions 
of  flow  and  the  role  of  originas  and  destination  the  subsequent  model  can 
be  converted  to  one  with  a single  origin  and  many  destinations.  The 
traffic  input  originating 


Figure  1. 


at  node  i and  destined  for  N is  denoted  by  r^.  The  routing  » i * 
is  the  one  for  which  all  nodes  j < i route  their  traffic  in  the  clockwise 
direction  and  all  nodes  j _>  i route  their  traffic  in  the  counterclockwise 
direction 


ROUTING  Rj 


Figure  2 

as  shown  in  Figure  2.  Given  a routing  the  flows  on  each  undirected 
link  (j-l#j)  in  the  clockwise  and  counterclockwise  direction  are  denoted 
by  f”(i)  and  ft(i)  respectively  and  are  given  by 


fj(i) 


9 


We  will  consider  the  case  where  the  length  of  a link  (i,Z)  is  given 
by  am  equation  of  the  form 

(1)  DU  -d(fi£) 

where  f^  is  the  flow  on  link (i, A)  during  the  preceding  period  and 
d is  a real  valued,  continuously  differentiable  and  monotonically 
increasing  function  of  flow  with  d(0)  ^ 0.  For  simplicity  we  assume  that 
the  function  d is  the  same  for  all  links  but  this  does  not  affect  materially 
the  analysis  that  follows.  Since  the  flow  f ^ depends  only  on  the  preceding 
routing  the  same  is  true  for  the  length  . It  appears  that  this  simplest 
of  all  possible  situations  is  the  only  one  that  can  be  analyzed  effectively 
in  a finite  node  network  context.  The  practical  situation  where  D . ^ is 
taken  to  be  the  average  time  delay  for  a message  to  traverse  link  (i,£)  can 
be  reasonably  modelled  by  a function  d of  the  form 


<2)  d(fu)  - PU  ♦ TU  . 9a(fiJt) 

where 

Pi£  “ Average  processing  plus  propagation  delay  per  message 
* Average  transmission  delay  per  message 
®i£  <f i&)  * Average  queuing  delay  per  message  when  the  average 
flow  on  link  (i,A)  is  f ^ . 

The  quantities  and  T^  are  independent  of  the  flow  f^  while  the 
dependence  of  on  f ^ is  determined  by  the  statistics  of  the  traffic 
arriving  at  i and  routed  through  l.  If  these  statistics  can  be  adequately 
modelled  by  an  M/M/1  queue  then  takes  the  form  [6]  , [7] 


(3) 


§ 
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where  is  the  transmission  capacity  of  link  Ci,4) . We  mention,  however, 
that  on  the  basis  of  experiments  conducted  thus  far  it  is  unclear  whether 
the  average  delay  per  message  in  the  ARPANET  can  indeed  by  modelled  as  in 
(2) . This  may  be  due  to  peculiarities  of  the  ARPANET  hardware  which  are 
little  understood  at  present.  We  now  define  the  shortest  path  algorithm 
Given  a routing  R^  we  define  the  distances  D ti , j ) , D+  (i , j 1 of  node  j to 
the  destination  in  the  counterclockwise  and  clockwise  directions  respectively 


D (i,j)  - I d[f . (i) ] 
4-1  * 


0+(i,j) 


4-j+l 


dtf^(i)]. 


If  o~(i,i)  - D+(i,i)  then  the  algorithm  sets  the  next  routing  to  R^ 

D~(i,i)  / D+(i,i)  the  algorithm  sets  the  next  routing  to  R^  where  the  node  n 
is  such  that 


D~(i,j)  >,  D (i, j)  for  j j>  n 

D~  (i , j ) < D+(i, j)  for  j < n . 

It  cam  be  easily  shown  that  if  D~(i,i)  + D+(i,i)  the  next  routing  Rn  is 

uniquely  determined  by  the  relations  above.  Given  am  initial  routing  R° 

12  k k+1 

we  consider  the  sequence  of  successive  routings  R,R,...R,R  , 

generated  by  the  algorithm. 

The  quantity  d(0)  may  be  viewed  as  a bias  factor.  It  represents  link 
length  at  zero  flow.  The  following  proposition  shows  that  if  d(0)  - 0 and 
the  first  two  routings  are  different,  i.e.  R°  f R1  then  the  algorithm  ends 
up  oscillating  between  the  two  extreme  routings  R^  and  R^  which  is  the  worst 
possible  behavior  that  cam  occur.  In  the  context  of  (2)  the  case  d(0)  - 0 
corresponds  to  the  situation  where  the  processing  and  tramsmission  delays 


Pj^  and  Tj^  are  negligible  relative  to  the  queuing  delay  Qi2_. 


1 


11 


Proposition  1:  Let  d(0)  *0  and  assume  that  R »*R  . Then  there  exists  an 

— k k+1  k 

index  k such  that  for  all  k^k  either  R • R^  and  R * or  R " an^ 

Proof:  Let  R^  be  a routing  and  assume  that  the  routing  subsequent  to  R^  is 
r with  n jli.  For  concreteness  assume  that  n < 1.  We  will  show  that  either 
i • n or  else  the  routing  subsequent  to  Rq  is  Rj  with  j 7 i. 

Xf  ii*N  then  since  Rft  is  the  routing  subsequent  to  R^  we  have 

(4)  D”(i,n-1)  < D+(i,n-l)  - D+(i,i). 


We  also  have 

CS)  D+(i,i)  * D+(n,i), 

(6)  D'(n,i)  * D‘(i,n-1). 


From  (4)  - (6)  we  have 

D+(n,i)  * D+(i,i)  > D’(i,n-1)  * D’(n,i) 


so  finally 

D+(n,i)  > D"(n,i). 


It  follows  that  in  the  routing  R^  which  is  subsequent  to  Rft,  node  i will 

switch  his  traffic  to  the  clockwise  direction  so  that  j > i. 

We  can  show  using  a very  similar  argument  that  if  n > i then 
either  i«l  or  else  the  routing  subsequent  to  RQ  is  Rj  with  j < i. 

Thus  we  have  that  the  number  of  nodes  that  lie  between  two 
successive  routings  is  increasing  at  each  iteration  if  none  of  these 
routings  is  or  R^.  On  the  other  hand  if  the  current  routing  is  R^  or 
R^  then  the  next  routing  will  clearly  be  Rjj  or  R1  respectively.  This  proves 


i 
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Che  proposition.  Q.E.D. 

Notice  that,  if  d(0)  -0,  the  situation  R0-^1  can  only  occur  if 
D"(i>  1)  «D+(i,i)  where  i is  the  node  for  which  R°-Ri.  Thus  if  we  add  any 
e > 0 to  any  one  of  the  node  inputs  we  will  have  R°  i R1  and  the  algorithm 

will  again  end  up  oscillating  between  R^  and  R^  We  provide  an  example 
illustrating  the  result  of  Proposition  1.  Several  additional  examples 

involving  more  general  topologies  and  multiple  destinations  may  be  found 

in  14]. 

EXWT"ple ; Consider  a 16-node  ring  network  where  node  16  is  the  destination. 
Let  r - 1 for  i - 1, . . . ,7,9, . . . ,15  .and  rg  « e > 0.  If  e - 0 and  the  initial 
routing  is  Rg  then  by  symmetry  all  subsequent  routings  equal  Rq.  If  e 
is  very  small  but  positive  then  for  the  case  where 

d(f)  - f 

the  sequence  of  generated  routings  is  Rg , R^Q,  R3>  R^,  R^,  R^g*  Rj_»*** 

This  fact  can  be  verified  via  a straightforward  calculation  in  Figure  3 
which  shows  the  flow  patterns  corresponding  to  successive  routings. 

We  now  turn  our  attention  to  various  notions  of  equilibria  and 
stability.  Wa  say  that  Ri  is  an  equilibrium  routing  if 

D~(i,i-1)  < D+(i,i-l),  and  D+(i,i)  < 

It  follows  from  this  definition  that  Ri  is  an  equilibrium  routing  if  and 
only  if  it  repeats  itself  via  the  shortest  path  algorithm. 

We  say  that  a node  i is  an  equilibrium  node  if 

d” (i,i)  < D+(i,i) , and  D+ (i+l,i)  < D* (i+l,i) 

In  words  a node  i is  an  equilibrium  node  if  he  switches  his  traffic  in 
both  cases  where  the  routing  is  R^  and  Ri+^. 
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He  say  that  an  equilibrium  routing  R^  is  locally  stable  if  routing 
R^+^  generates  either  R^  or  R^_^  through  the  algorithm,  and  routing 
generates  either  R^  or  R^+^.  We  say  that  an  equilibrium  node  i is  locally 
stable  if  routing  R^  generates  R^+^  via  the  algorithm,  and  routing  R^_^ 
generates  R^.  The  definition  of  local  stability  is  based  on  the  idea  that 
when  the  algorithm  starts  "close  enough  to  equilibrium”  it  should  not  lead  to 
a "growing”  oscillation.  The  following  proposition  complements  Proposition  1 
and  suggests  that  the  bias  level  d(0)  should  exceed  a certain  positive  value  in 
order  for  an  equilibrium  routing  or  node  to  be  locally  stable. 


Proposition  2:  a)  An  equilibrium  routing  R^  is  locally  stable  if 

r,  N-l  „ r.  N-l  - 

d(0)  > max  Z m.  , ~ Z nu  } 

2 £-1  1 2 Ul  1 

tyi.  A*i-1 


where 

m4  - max{d* Cf) (f^(i-l)  < f < ^ (i)}  , for  l - 

- max{d'  Cf)  Ifj^Ci)  < f < Ci-1) } for  1 - 

mA  - max{d' (f ) | f“ (i)  < f < fj (i+1) } for  A - 

m^  - max{d' (f) | f *+1 (i+1)  < f < f*+1 (i) } for  l - 

where  d' (f)  denotes  the  first  derivative  of  d at  f . 


1.. ...1-l 
i+1,..., N-l 

1. .  . . .1-2 
i,. . . ,N-1 


b)  An  equilibrium  node  i locally  stable  if 

r.  N-l  _ 

d (0)  > ^ Z a. 

2 1-1  1 

where 

mz  - max{d' (f) |f"(i)  < f < f‘(i+l)} 
- max{d' (f) |f*(i+l)  <f  <£*(!)} 


for  l * 1 , . . . , i 
for  l • i+1, . . . ,N-1. 


_ 


■■■■ 
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The  proof  of  Proposition  2 involves  a straightforward  but  lengthy 
argument  and  will  be  omitted.  It  can  be  found  in  [4] . 

Proposition  2 implies  that  in  order  to  ensure  local  stability  the  bias 
d(0)  should  exceed  a level  that  depends  strongly  on  the  traffic  conditions. 

This  level  is  proportional  to  the  input  at  or  near  the  equilibrium  and  to  a 
global  measure  of  the  derivative  d'  along  the  ring.  Thus  it  may  be  necessary 
to  choose  a value  of  d(0)  which  is  large  relative  to  r and  d*  in  order  to 
ensure  stability  for  a broad  range  of  input  traffic  conditions.  This  can  be 
accomplished  by  adding  a large  constant  to  d.  On  the  other  hand  this  would 
introduce  a tendency  in  the  algorithm  to  generate  routings  close  to  the  min- 
hop  routing  (i.e.  one  that  selects  routes  according  to  minimum  number  of  links 
to  the  destination) . As  a result  the  algorithm  would  tend  to  be  insensitive 
to  congestion.  This  tradeoff  will  be  reencountered  in  the  next  section. 

The  point  of  view  that  has  been  adopted  in  this  section  is  one  whereby 
the  algorithm  is  viewed  as  a dynamic  system  with  a finite  number  of  states 
(the  finite  collection  of  possible  routings) . Unfortunately  the  study  of 
dynamic  behavior  and  stability  properties  of  such  systems  is  notoriously 
difficult.  To  begin  with  there  is  no  accepted  definition  of  equilibrium,  and 
in  fact  we  saw  that  in  the  ring  network  context  there  sure  two  types  of 
"equilibria"  that  axe  of  interest  - equilibrium  routings  and  equilibrium  nodes. 
Furthermore  there  axe  no  established  methodological  tools  that  can  be  helpful 
in  a finite  state  system  framework.  As  a result  our  progress  has  been  limited 
to  the  results  just  discussed.  We  are  thus  motivated  to  consider  approximation 
of  the  discrete  system  with  a continuous  system  having  a continuum  of  states. 
For  such  systems  there  is  an  effective  and  well  developed  stability  theory 
that  can  be  utilized  for  analysis.  We  take  this  approach  in  the  following 
two  sections  where  we  introduce  a network  with  a continuum  of  nodes.  Despite 


th«  radical  nature  of  this  step  the  analysis  provides  informative  results 
and  clarifies  the  role  of  averaging  the  effects  of  several  past  routings  as 
a means  of  damping  oscillatory  behavior.  The  validity  of  our  approach  is  supported 
by  the  fact  that  qualitative  conclusions  drawn  from  the  continuous  node  model 
have  been  verified  computational ly  in  finite  node  models. 

3.  A Continuous  Model  of  a Ring  Network 

We  consider  a continuum  of  nodes  arranged  in  a ring  and  sending  traffic 
to  a single  destination  as  shown  in  Figure  4. 


3/4 


Figure  4 

Points  on  the  ring  are  identified  with  their  distance  t from  the  destination 
in  the  counterclockwise  direction,  where  t is  normalized  to  take  values  in 
the  interval  [0,1].  Traffic  can  move  on  the  ring  in  both  directions . 

For  every  t in  [0,1]  we  denote  by  r(t)  the  input  density  at  t.  The 
meaning  of  the  function  r is  that  for  any  subinterval  [t^t^]  of  [0,1]  the 
total  input  traffic  originating  at  nodes  in  is 


r (t)dt 


We  assume  that  r is  continuous  on  [0,1]  and  r(t)  > 0 for  at  least  on  te  (0,1) 

Note  that  a network  with  a finite  number  of  nodes  can  be  modelled  by  a function 
r containing  impulses  and  such  a function  can  be  approximated  by  a continuous 
function  consisting  of  narrow  triangular  pulses  of  finite  height.  We  are  interested 
in  routings  specified  by  points  y in  [0,1],  where  the  flow  splits,  i.e. points 
larger  than  y send  their  flow  counterclockwise  (or  in  the  positive  direction)  and 
points  smaller  than  y send  their  flow  clockwise  (or  in  the  negative  direction  ) . 

To  a given  function  r and  routing  y,  there  corresponds  at  every  point  t a flow 


f (y,t) 


Jy  '(T)dT 


.»  and  a flow  in  the  negative  f (7.0  given  by 


y f t 


(8)  f (y,t) 


57t  r(T)dT 


t < y 


tfy 


In  order  to  introduce  an  algorithm  such  as  (A)  in  the  framework  of 
the  continuous  model  we  consider  a function  d mapping  flows  into  the  non- 
negative real  numbers.  The  meaning  of  d is  that  given  a routing  y and  any 
point  t,  the  distances  D~  and  D*  from  t to  the  destination  in  the  negative 


and  positive  direction  are  given  by 


(9>  D (y,t)  - ; d[f  (y,T)]dT 
CIO]  D+(y,t)  - J^dlf+Cy.TJldT. 
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We  will  assume  that  d is  a monotonically  increasing  function  of  f with  every- 
where continuous  derivative.  We  further  assume  that  d(0)  >0.  As  Proposition  1 
shows,  the  case  where  d(0)  - 0 is  not  interesting  from  a practical  point  of 
view. 

We  consider  the  following  algorithm  for  generating  routing  sequences 

(All  Given  a routing  y^,  the  next  routing  yJc+1  is  th*  solution  of 
the  equation 

Ul)  D'tYfc'W  " D+(VW 

It  will  be  shown  as  part  of  Proposition  3 that  equation  (11)  has  a 
unique  solution  for  every  y^EtO.l] . Note  that  since  we  have 

D"(yk,t)  < 0’(yk,yk+l)  - D+(yk,yk+1)  £ D+(yk,t)  if  t £ yk+1 

and 

o“(yk,t)  > o’(yk,yk+1)  - D+(yk,yk+1>  > D+(yk,t)  if  t > yk+1 

it  follows  that  a routing  yk+^  determined  from  (11)  is  such  that  every  point  t 
routes  its  flow  in  the  positive  or  negative  direction  according  as 
D“(yk,t)  > D"(yk,t)  or  D_(yk,t)  £D+(yk,t),  i.e.  according  to  minimum  distance 
to  the  destination. 

We  say  that  y*  e!0,l]  is  an  equilibrium  if 
(12)  D~(y*,y*)  - D+(y*,y*)  . 

We  first  show  some  preliminary  results  relating  to  existence  and 
optimality  properties  of  equilibria: 

Proposition  3:  There  exists  a unique  equilibrium  y* e (0,1).  Furthermore 

equation  (11)  has  a unique  solution  yk+1  for  every  yk- 

i i 
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Proof:  Using  (9)  and  (10)  we  have  for  all  y and  t 


•dlf  (y.t)J. 


We  have  d(0)  >0  and  d is  nonoconically  increasing, so  > 0 and 

< ®*  for  fixed  y,  the  function  D~(y, •)  is  continuous, 

moootonically  increasing  and  satisfies  D~(y,0)»0,  while  the  function 
D+ (y,*>  is  continuous  oonotonically  decreasing  and  satisfies  D+ (y,l)  * 0. 
Hence  the  equation  D (y,t)  «D  (y,t)  has  a unique  solution  in  t lying  within 
(0,1).  Denote  by  g(y)  the  solution  corresponding  to  y.  The  function 
g: [0,1]** [0,1]  can  be  easily  shown  to  be  continuous  and,  by  Brower's  fixed 

it  it 

point  theorem  ([8],  p.  161),  g has  a fixed  point  y . This  y is  an 

* * it  * 

equilibrium.  If  there  exist  two  equilibria  y^  and  y^  with  y^  < y 2,  then 
since  d(f)>  0 for  all  f>  0,  we  must  have 


- * *,  . • * * - * * + * * 

D (yl’7P  (yl»y2*  -D  (y2*y2)“D^ ^(y2»y2) 

+ **.  + * * ^ + * * -*★ 

d (y2»y2)<D  (y2,yt)<D  (y.,y.)»D  (y.,y.) 


which  is  impossible.  Hence  the  equilibrium  is  unique.  Q.E.D. 


Proposition  4:  The  equilibrium  minimizes  over  all  y£  [0,1]  the  expression 


J(y)  * fp[f+(y»t)  ]dt  +(*  p[f”(y,t)]dt 
Jn  •'O 


•'O  •'0 

where  p is  any  function  satisfying  for  all  f 


(14)  p'  (f)  - d(f) 

and  p'  denotes  the  first  derivative  of  p. 


Proof:  The  first  derivative  J' (yj  of  J is  given  by 


p'[f+(y,t )]  3f*,]y>t)  dt  +£p’  [f~(y,t)l 


It  can  be  seen  from  (7)  and  18)  that 


U6) 


SfVti. 

dy 


(.17) 


af . tij£l  "■ 
dy 


r(y) 

if 

y < t 

0 

if 

t < y 

0 

if 

y < t 

r(y) 

if 

t<y  . 

Combining  equations  (14)  - (17)  we  obtain 


J*(y)  -r(y)[  d[f+(y,t)ldt+  J*J  d[f'(y,t)]dt  ] , 
or  equivalently 

J*  (y)  -r(y)[D”(y,y)  -D+  (y,y)]. 


If  y is  an  equilibrium  it  can  be  seen  that  we  have 


d (y.y)  * D (y,y) 


if  y^y 


D_(y,y)  > D (y.y) 


if  y > y . 
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Thus  J*  (y)  £0  if  y <^y*t  J’  (y)  >0  if  y*  <y,  and  J'  (y*)  - 0. 
It  follows  that  y*  minimizes  J.  Q.E.D. 


Proposition  4 shows  that  one  can  minimize  the  integral  of 
average  delay  over  the  ring  by  choosing  the  function  d to  be  marginal 
delay  and  by  guaranteeing  that  the  algorithm  converges  to  an  equilibrium. 
The  needto  use  marginal  delays  as  link  lengths  in  order  to  minimize  total 
average  delay  has  been  pointed  out  earlier  in  a different  algorithmic 
context  [9] . The  following  discussion,  however,  casts  doubt  as  to  whether 
the  algorithm  will  converge  to  an  equilibrium  when  the  link  lengths  are 


f 


chosen  to  be  the  marginal  delays.  In  any  case  Proposition  4 suggests  that 
convergence  of  the  algorithm  to  an  equilibrium  is  desirable  since  a function 
p satisfying  (14)  is  monotonically  increasing  and  convex  and  hence  an 
equilibrium  will  at  least  be  a reasonably  good  routing  even  if  it  is  sub- 
optimal  in  terms  of  a particular  design  objective. 

We  now  consider  the  convergence  properties  of  the  algorithm.  For 
any  ye [0,1]  we  denote  by  g(y)  the  unique  solution  in  t of  the  equation 
D~(y,t)  ■ D+(y,t)  (c.f .Proposition  1).  Thus  Algorithm  (Al)  can  be  written 

(18)  yk+1  - g(yk). 

We  have  for  all  ye [0,1] 

J*g(y)  ri 

d[f  (y,t)Jdt  - / d[f+(y,t)  ]dt  - D+[y,g(y)] 

0 

We  evaluate  the  first  derivative  g*  (y)  * for  ye (0,1).  Differentiation 

in  (19)  yields 


j d'[f  (y,t)  Jdt  + d(f“(y,g(y)^g*  (y) 

•*0 

- j d' [f+(y,t)]dt  - d[f+(y,g(y))]g' (y) 

J9(y) 

n + r9ly>  - 

d'[f  (y,t)]dt  - J d*  If  Cy,tl)dt 
. . •'crfy)  Jo 


9’(y) 


d[f“(y,g(y))l  + d[r(y,g(y) ) ) ] 


We  have  for  t f y 


3d[f  (y,t) 1 
3y 


d'  [f  (y,t)] 


3f+(y,t) 


3d[f  (y,t) ] 
3y 


d* (f  (y,t) 1 


3f  (y,t) 
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Combining  (20)  - (22)  with  (16) , (17)  we  obtain 

. min{y,g(y)>  , + 

r(Y HJ„  + Jmax{v.a(v)}d'If  (y,t)3dtl_ 

C23)  g’(y)  - - D : + 

d[f  (y,g(y) ).)  + d[f  (y,g(y))J 


At  the  equilibrium  y*  we  have  y*  ■ g(y*l  and  f (y*,y*l  * £ ly*ty*)  m °/  so 


(23)  yields 


g' (y*) 


J»y*  p 1 

0 d'If"(y*/t)]dt  -I-  (y*>t))dt 


2d(0) 


By  using  a theorem  of  Ostrowski  ( [8] , pp.  300-301)  we  can  state  the  following 
local  convergence  and  rate  of  convergence  result  for  algorithm  (Al) . 

Proposition  5:  Let  y*  be  the  equilibrium.  Then  if  |g* (y*) ( K 1 or 


equivalently 


d(0)  > 


>(y*)  lf  o* d'  tf~(y*>t)]dt  [**^*^>1**1 


there  exists  an  open  interval  I containing  y * such  that  if  yQ£ I the  sequence 
(yk>  generated  by  algorithm  (Al)  remains  in  I and  converges  to  y*.  Further- 


more if  yk  f y*  for  all  k there  holds 


>yk+l  y*' 


(26)  limjup  |y  — -p~  s ljgJtup  lyk  ~ y*'  " 'g,(y*)l  * 


When  the  equilibrium  y*  has  the  property  specified  in  the  first  conclusion 
of  Proposition  5 we  say  that  it  is  locally  stable.  If  |g'  (y*) | > 1 then  the 
linearized  system  corresponding  to  yk+1  ■ g (yfc)  is  unstable,  so  the 
algorithm  tends  to  diverge  from  y*  when  started  close  to  it.  Notice  the 
similarity  of  equation  (25)  with  the  corresponding  local  stability  conditions 
for  finite  node  networks  (cf.  Proposition  2). 
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A sufficient  condition  for  global  convergence  of  algorithm  (Al) 
can  be  obtained  by  requiring  that  g be  a contraction  mapping,  i.e.  for  some 


p€(0,l)  there  holds 


U(y)-y*l*ply-y*l.  , W.U- 


From  Taylor's  theorem  and  the  fact  g'  (y)  < 0 we  have 


|g(y)  -y*l  * I f 9*  cz)dz| 

•'■a* 


& - max  ^ 

0*f*J  r(t)dt 

0 


d'  Cf) 


From  (23)  we  obtain  for  all  z 


. . , . I * &r^z)  f 1 - \ 

19  (z) I 2d(0) 


Thus  (27)  is  satisfied  if 


J *r(z)[l-  lz-g(z)|]dz 


sup  2d(0) 
y€[0,i; 

7 + y 


or  equivalently  if 


fy  r(z) [1  - |z  - g(z)  ]dz 


d(0)  >7  sup 

y€[0,l] 

7 + 7* 


» 


r - 


This  will  be  true  in  particular  if 
(29)  d(0)  >£p 

where  R«max  r(t).  The  conclusions  of  the  preceding  discussion  are 
O^t^l 

summarized  in  the  following  proposition. 

Proposition  6:  If  condition  128)  or  the  stronger  condition  (29)  holds, 

every  sequence  {yk>  generated  by  algorithm  (Al)  converges  to  the  equilibrium  y*. 


When  the  equilibrium  y*  has  the  property  specified  in  Proposition  6 we 
say  that  it  is  globally  stable. 

In  order  to  put  the  results  obtained  thus  far  in  better  perspective 
let  us  write  dCf)  as 

d(f)  » a + dCf) 

where  a • d(0)  represents  the  bias  factor.  For  fixed  input  density  r we 
have  that  to  each  positive  value  of  bias  a there  corresponds  an  equilibrium 
y*  . The  equilibrium  is  locally  stable  for  a satisfying  [cf.(25)] 

r(y*)  [jta  d’tf'<Vt)ldt  <3'[f+(y*,t)]dt]  ^ 

(30)  a > a 

2 

and  globally  stable  fora  satisfying  Icf.(29)] 


(31) 


> 


As  a increases  the  corresponding  equilibria  tend  to  become  stable.  Further- 
more from  (24)  and  (26)  it  can  be  seen  that  the  speed  of  convergence  of  the 
algorithm  is  accelerated  as  a increases.  On  the  other  hand  it  is  easy  to  see 


* l 


j as  a-*»,  which  in  the  context  of  the  routing  problem  means  that 


j 

j 


1 


1 

4 


that  y* 
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the  algorithm  becomes  increasingly  insensitive  to  congestion  as  . 

Since  in  a practical  situation  we  are  interested  in  the  stability  Properties 
of  the  algorithm  for  a broad  range  of  inputs  let  us  consider  input  densities 
of  the  form 

(32)  r^(t)  « Xr  (t) 

where  X is  a positive  parameter.  Then  it  is  clear  that  as  X increases  a larger 
value  of  bias  is  necessary  in  order  to  stabilize  the  algorithm. 

For  example  if  d is  of  the  form 

(33)  d(f ) » a + Sfn 

where  0>O,  n>0  then  from  (3)  and  (31)  we  see  that  if  r is  changed  to  Xr 
as  in  (32) , then  the  stability  threshold  level  of  the  bias  is  multiplied  by  Xn. 
Thus  for  fixed  a and  r there  is  a choice  of  X for  which  the  corresponding 
equilibrium  is  unstable.  Incidentally  the  expression  (33)  for  d has  an 
interesting  property,  namely, that  the  set  of  all  possible  equlibria  {yal<x>0} 
as  well  as  the  set  of  all  locally  or  globally  stable  equilibria  is  independent 
of  the  level  of  input  X and  depends  only  on  r.  This  is  straightforward  to 
verify  using  (33)  and  the  fact  that  if  r is  changed  to  Xr  and  a is  changed 
to  Xna  then  the  routing  sequences  generated  by  the  algorithm  are  unaffected. 

Choosing  the  Bias  as  a Function  of  the  Current  Routing 

Since  stability  of  the  algorithm  depends  strongly  on  the  level  of  bias 
and  the  level  of  input  tie  are  motivated  to  consider  schemes  where  the  bias 
is  not  held  fixed  but  is  rather  adjusted  adaptively  on  the  basis  of  currently 
available  information.  An  interesting  scheme  is  to  use  a length  function 
of  the  form 


„ _ 


. ..  _ . „ 


! 


26 


d(f,y)  ■ a(y)  + d(f) 

A 

whore  d is  a continuously  differentiable,  monotonically  increasing  function 

A 

with  d(0)  • 0,  and  a(y)  is  taken  to  be  some  monotonically  nondecreasing 
function  of  DT  Cy)  given  by 


,(y>  •/.  d[f+(y,t)]dt  d(f"(y,t)]dt. 


For  example  a quadratic  function  of  the  form 


a(y)  - Y0  ♦ Dx(y)  + Y2tDT(y)]‘ 


(34) 

v * 

where  y , y, » Y.,  are  sene  experimentally  determined  nonnegative  constants 

seems  suitable.  In  the  context  of  a finite  node  network  with  not  necessarily 

a ring  structure  a scheme  like  this  can  be  very  easily  implemented . In  this 

case  d (y)  can  be  calculated  as  the  sum  of  all  reported  link  "delays" 

T 

A 

d(fiA).  The  bias  a(y)  can  be  computed  by  each  node  via  a formula  such  as 

(34)  and  the  link  length  can  be  computed  as  ■ a(y)  + dtf^). 

A scheme  of  the  type  just  described  can  be  analyzed  along  similar  lines 

as  earlier  in  this  section.  It  has  been  tested  in  quite  extensive  numerical 

experiments  involving  finite  node  networks  and  it  was  shown  to  have  very 

satisfactory  performance  14] , [3] . This  can  be  attributed  to  the  fact  that 

the  level  of  bias  increases  or  decreases  with  the  level  of  input  thus 

providing  automatic  scaling  with  respect  to  input  level.  In  fact  it  can  be 

* * _ 

easily  seen  that  if  d has  the  form  d(f)  » 8r  where  3>0,  n>0  and  we  choose 
a(y)  » YDT(y)  where  y>0,  then  for  every  input  density  function  of  the  form 
Xr (t) , X>0,  the  sequences  generated  by  the  algorithm  do  not  depend  on  X. 
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4.  Averaging  the  Effect  of  Several  Routings 

In  this  section  we  show  that  the  stability  properties  of  the  shortest 
path  algorithm  of  the  preceding  section  can  be  improved  if  link  lengths  suitably 
depend  on  flows  corresponding  to  several  past  routings.  There  are  several 
possibilities  along  these  lines.  Some  examples  are  as  follows; 

a)  Averaging  over  the  present  and  the  past  n routings. 

Given  a sequence  of  past  routings  Yk'yk„j/  * • define  for  any 
t in  [0,1]  "averaged"  distances  to  0 and  1 by 


(35) 

5" (yk»yk-i»***»yk-n,t) 

- nfl  A dlf  (yk-i’T)ldT 

0 i-0 

(36) 

(yk,yk.i y^rti 

- J -V  S a[f+(y  ,T)]dT 

k n+1  1*0  15  i 

1 

Thus  distances  are  calculated  by  integrating  t«o  1* 

an  averaged  length  over  the  routings  yk>  • • • »yk„n»  ln  pl*c*  o£ 
which  is  the  length  corresponding  to  the  last  routing. 

The  new  routing  y^  i»  obtained  from  the  equation 

(37)  r (yk»yk.l»*-*»yk.n»yfe+i)  Vh WW- 

It  is  easily  seen  that  this  defines  uniquely  yfc+1  in  terms  of  yk»yk-1 yk-a' 

As  earlier  we  write  the  corresponding  equation  as 

yfcfl  “8(Wl*  * * * ^k-n*  * 

A routing  y is  said  to  be  an  equilibrium  if 


(38) 


section. 


We  can  define  local  stability  of  y in  the  obvious  way.  We  have 
that  y*  is  locally  stable  if  it  is  also  a stable  equilibrium  of  equation 
(38)  linearized  around  y*  (see  [8]  p.  353).  It  is  a known  fact  that  this  is 
true  if  all  roots  of  the  characteristic  polynomial 


C(p)  -P 


teiy.J  ° . ag(y*I 


an 


k-l 


. ag(y*)  ag(y*) 

4W  ^k-n 


lie  inside  the  unit  circle,  (l.e.  have  modulus  less  than  unity).  We  cal’ 

culate  the  derivatives  fjj — . 

dyk-i 

We  have  for  cr>0  similarly  as  earlier  for  every  1 

* 

4’W'(r*.t)Jdt  +J‘  . a' If*(y*,t)]dt}  . 


Define 


(39) 


* 1 

a'  [f“(y*,t)Jdt  + J * d*If+Cy*,tlJdt} 

2dC0j  q y 


Note  that,  from  Proposition  5,  y is  locally  stable  for  algorithm  (Al)  if 
H < 1.  The  characteristic  polynomial  can  be  written  as 


(40) 


. n+1  , _u  n . u n-l , . u , u 

C(p)-p  +Sjp+^ip  + •••+ 51  p+ • 


We  now  use  the  following  fact: 

Lama:  Let  § be  a positive  scalar  and  n be  a positive  integer.  The  roots  of 
the  polynomial 
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p“*l+£pa  + Spn*l  + ...  +5p  + £ 

li«  inside  the  unit  circle  if  and  only  if  5 < l. 

Proof:  This  result  cen  be  shown  by  straightforward  application  of  Jury's 

stability  test  ([10],  p.  97-98).  Q.S.D. 

We  now  apply  the  result  of  the  leans  to  our  problem.  We  have 

that  the  equilibrium  y will  be  locally  stable  if 

< n + 1. 


— — i 


It  follows  using  (39)  that  in  the  averaged  algorithm  the  bias  level  must 


satisfy  * 1 

r(y  ){  j d'[f-(y*,t)ldt  + J * d([£+(y*(t)J  dt } 


dCO)  > 


2(tH-l) 

in  order  for  the  corresponding  equilibrium  y to  be  stable.  If  we  compare 
this  with  the  earlier  algorithm  [cf.  (25)]  we  see  that  in  tha  averaged 
algorithm  the  bias  threshold  level  for  stability  is  reduced  by  the  factor 


V over  the  one  of  algorithm  (Al) • For  a given  traffic  input,  and  any 
trt-1 


given  bias  level  the  corresponding  equilibrium  can  be  made  stable  by 
averaging  delays  over  a sufficiently  Urge  number  of  periods. 

Regarding  rate  of  convergence,  Ostrowskl's  Theorem  again  applies, 
We  have  from  the  proof  of  Th.  10.1.3  of  [8]  that  given  any  e>0  there 
exists  a norm  j|*H  on  R such  that  if  yk^y  for  all  Ic 


i'(yk+ry*---»yv-m4.ry*)" 


k-n+1 


lia  sup  * * 


k-1 


il(yk-y  » • • • *yk-n"y  ^ ^ 


* P(j*,n)  + c, 


where  p (H,n)  is  the  maximum  root  modulus  of  the  characteristic  polynomial 
C(p)  of  (401.  It  can  be  seen  that  for  fixed  n we  have  P(n,n)-0  as  *-0. 


— ■ — - - ... 


If  P^*****?,^  ar®  the  roots  of  C(p)  we  have  I Pj_*  • • Pq+J  * 80  that 

a n|  1 

P(H,a)  * (^jj)  . It  follows  that  for  fixed  ti  we  have  P(P>,n)-*l  as  n-*®, 

so  that  the  rate  of  convergence  deteriorates  as  n~*®.  Thus  too  ouch  damp* 
ing  can  slow  down  the  speed  of  convergence  of  the  algorithm. 


b)  Fading  Memory  Scheme 

This  scheme  is  similar  to  the  preceding  one  except  that  the  lengths 
corresponding  to  all  past  routings  are  averaged  via  a fading  memory  scheme.  Given 
the  sequence  of  all  past  routings  . . .},  the  next  routing  yk+1  is 

determined  as  the  solution  of  the  equation 
/k+1  * 1 + 

(4i)  r a;<t)<it  - r « (tidt 

o * 

where  6^  and  6+  are  obtained  by  the  following  recursive  fading  memory 
scheme  with  decay  factor  &€[0,1) 


8k(t)  " <*6k-l(t)+ 
5k(t)  * 06k-i(t>+ 


Alternatively  we  can  write 


- (1-3)  3 d[f“(yi.t)l 


*£(t)  - (1-3)  ^2.  9k-id[f+  (y^.t)] 


Let  us  write  the  solution  of  (46)  as 


(44)  yk+l  “ 8<yk,yk-l,***,)- 

Let  us  also  consider  the  linear  system  obtained  by  formal  linearization  of 

* 

(44)  around  the  equilibrium  y . We  have  similarly  as  earlier  that  this 
linearized  system  is 


yk+l  “ *‘*(1  * 0)Iyk  + ^k-l  + & yk-2  + — 1 


(45) 


I 


where  n is  given  by  (39).  Let  ua  denote 


m *k  * *k-i  + B ’k-2  + 


Then  we  have  for  all  k 


(4a  7k+1  * -w  -6)yk  - 

(47)  \+l  ■ \ * e\ 

and  it  follows  that  the  linearized  system  (45)  is  in  effect  the  two- 
dimensional  system  described  by  (46)  and  (47).  This  latter  system  Is  stable 
if  both  eigenvalues  of  the  system  matrix 


-1*(1  - 0) 
1 


-mi  - 0)0 


lie  within  the  unit  circle.  These  two  eigenvalues  can  be  calculated  to  be 

0 and  0 - ^(1  - 0) • It  follows  that  the  linearized  system  is  stable  if 

* 1-0 

Although  we  do  not  provide  a proof,  it  is  possii  .e  to  establish  rigorously 
that  stability  of  the  linearized  system  (45)  implies  local  stability  of 
the  algorithm  (44)  and  thus  we  have  the  result  that  the  threshold  value  of 
bias  for  stability  in  the  fading  memory  scheme  is  reduced  by  the  factor 

over  the  one  of  algorithm  (Al).  The  optimal  speed  of  convergence  is 

1 ± g — — — 

obtained  when  the  eigenvalue  0 - mi  -0)  equals  zero  in  which  case  a super- 
linear  rate  of  convergence  is  obtained.  This  is  so  when  3 • For  ocher 

values  of  3 in  the  interval  (£^j  , 1)  the  rate  of  convergence  is  linear,  and 
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for  0<^  the  equilibrium  is  unstable.  As  6 is  increased  from  the  optimal 
value  towards  unity  the  rate  of  convergence  deteriorates. 

c)  Asynchronous  Length  Reporting 

This  type  of  scheme  is  patterned  after  a shortest  path  routing  algorithm 
where  nodes  report  asynchronously  the  lengths  of  their  outgoing  links  and  the 

shortest  paths  are  updated  after  each  report.  The  set  of  nodes  [0,1]  is 

partitioned  into  n subsets  which  we  call  Sj/S2' • • • »sn'  At  some  time,  say  0, 

the  nodes  in  report  their  lengths  averaged  over  the  flows  corresponding  to 
the  preceding  n routings  and  a routing  update  takes  place.  Then  at  time 
0^  > 0 the  nodes  in  S2  do  the  same  thing.  Similarly,  for  i * l,...,n-l,  at 
time  (a^  ♦ <?2  ♦ ...  ♦ o^)  the  nodes  in  s^+1  do  the  same  thing.  At  time 
(ox  + a 2 +...+cn>  the  nodes  in  again  report  their  lengths,  an  updating 
takes  place  and  the  process  is  repeated.  This  type  of  asynchronous  operation 
is  currently  in  use  in  the  ARPANET  [4]  where,  in  a finite  node  network 
context,  consists  of  a single  node  for  all  i.  There  are  also  other 
variations  of  asynchronous  operation  involving  for  example  averaging  over 
all  preceding  routings  via  a fading  memory  scheme.  This  type  of  algorithm 
is  described  and  tested  computationally  in  [4]  and  13] . The  analysis  of 
all  these  schemes  is  very  similar  as  that  of  the  averaging  schemes  described 
earlier  in  this  section.  The  details  are  quite  messy  and  may  be  found  in 
[4] , where  it  is  shown,  via  analysis  and  computational  experiment,  that 
asynchronous  operation  has  a substantial  beneficial  effect  on  the  stability 
properties  of  the  shortest  path  algorithm. 

5.  The  Case  of  a Network  with  an  Arbitrary  Topology 

The  extension  of  the  continuous  model  to  the  case  of  a network  with 
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arbitrary  topology  is  quite  straightforward . However , the  notation  required 
for  a precise  mathematical  description  is  very  cumbersome  and  tends  to  cloud 
the  main  ideas.  For  this  reason  our  presentation  will  be  somewhat  informal. 

Consider  the  case  of  an  undirected  network  with  a single  destination. 

Let  r be  the  input  density  function  mapping  points  on  the  undirectred  links 
of  the  network  to  the  nonnegative  real  numbers.  The  meaning  of  r again  is 
that,  given  any  interval  I on  a link,  the  total  traffic  input  originating 
at  this  interval  is  the  integral  of  r over  I.  We  view  the  set  of  points  on 
network  as  a subset  of  a Euclidean  space  of  appropriate  dimension,  and 
assume  that  r is  a continuous  function.  In  order  to  consider  notions  of 
length  we  associate  with  each  undirected  link  (i,£)  two  directions  i-Hl  and 
i-*i.  (There  may  be  more  than  one  links  connecting  a pair  of  nodes  within 
our  framework.  When  we  refer  to  a link  (i,A)  we  mean  a particular  link 
connecting  i and  l and  specify  further  when  there  is  danger  of  confusion) . 

A length  function  5 is  a function  which  assigns  to  each  point  on  an  undirected 
link  (i,i)  two  nonnegative  numbers  one  associated  with  the  direction  i-*! 
and  the  other  associated  with  the  direction  £,-*i.  We  assume  that  5 is  piece- 
wise  continuous  along  every  link  in  each  direction.  The  meaning  of  6 is 
that  given  any  two  points  on  a link  ti, A)  their  distance  in  the  direction  i-*£ 
is  obtained  by  integrating  5 as  defined  in  that  direction  between  the  two 
points.  The  distance  in  the  opposite  direction  !-*>i  is  defined  analogously. 
Similarly  we  can  consider  paths  between  points  on  possibly  different  links 
and  define  their  length  in  one  or  the  other  direction. 

We  now  associate  to  a given  length  function  6 a shortest  path  of  every 
point,  and  an  associated  routing,  we  assume  that  6 is  everywhere  positive. 


Given  any  point  we  consider  the  collection  of  paths  to  the  destination  and 
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their  associated  distances  specified  by  the  function  6.  A path  of  minimum 
distance  is  referred  to  as  a shortest  path  from  the  point  to  the  destination, 
and  the  corresponding  distance  is  referred  to  as  the  shortest  distance  of 
the  point  to  the  destination.  The  routing  corresponding  to  6 is  the  set 
of  points  for  which  there  are  more  than  one  equidistant  paths  to  the 
destination.  A routing  is  said  to  be  regular  if  it  does  not  contain  any 
nodes  of  the  network,  otherwise  it  is  said  to  be  singular. 

Given  the  function  5 , a shortest  path  of  each  point  and  the  corres- 
ponding routing  can  be  constructed  in  a simple  manner  along  similar  lines 
as  for  usual  networks.  Me  first  construct  a shortest  path  tree  for  the 
network  In  the  usual  manner  by  using  as (directed)  link  lengths  those  speci- 
fied by  the  length  function  6.  (The  length  of  the  directed  link  (1,4)  is 
the  Integral  of  6 along  (1,4)  in  the  direction  i-4).  This  gives  us  a 
shortest  path  and  the  associated  shortest  distance  for  every  point  on  the 
shortest  path  tree  Including  all  the  nodes  of  the  network.  A shortest  path 
for  points  on  links  that  are  not  part  of  the  shortest  path  tree  can  be 
obtained  as  follows: 

Let  (i,4)  be  a link  that  is  not  on  the  tree.  Let  and  Dx  be 

the  shortest  distances  of  nodes  i and  4.  The  shortest  distance  of  appoint 

t on  (i,^)  is 

D(t)  “min  (D^  + j 6xi^dt*  Di+J  *iX^dt^ 

where  6^  is  & in  the  direction  4~*1  and  6^  is  6 in  the  direction  1**4. 

It  can  be  seen  chat  the  routing  corresponding  to  6 is  regular  if  and  only 
if  each  (ordinary)  node  of  the  network  has  only  one  shortest  path  associated 
with  it.  If  a routing  is  regular  then  every  one  of  its  points  lies  in  the 


35 


"interior"  of  some  link.  Notice  that  the  preceding  construction  shows  that 
a routing  (regular  or  not)  consists  of  CL  - N + 1)  points  where  L and  N are 
the  number  of  undirected  links  and  nodes  respectively. 

Given  a shortest  path  tree  and  the  corresponding  routing  constructed 
as  just  described,  we  can  define  the  flow  corresponding  to  it.  At  each 
point,  say  t,  of  a link  (i,i)  there  are  two  flows  to  consider  (one  of  which 
is  zero);  the  flow  in  the  direction  i-*-i  and  the  flow  in  the  direction  l-i. 
Each  is  defined  in  the  natural  way  by  integrating  the  input  density  function 
r over  the  portion  of  the  network  that  lies  "upstream"  from  the  point  t, 
i.e.  over  the  set  of  points  the  shortest  paths  of  which  meet  t on  their  way 
to  the  destination.  At  the  points  of  a regular  routing  the  flow  is  zero  in 
either  direction.  Notice  that  if  5 is  such  that  the  corresponding  routing 
is  regular  the  flow  is  uniquely  determined  by  6 . Otherwise  the  flow  will 
depend  not  only  on  6 but  also  on  the  shortest  path  tree  selected. 

Suppose  we  are  given  a monotonically  increasing,  continuously 
differentiable  function  d mapping  flow  into  the  positive  numbers.  Given  a 
shortest  path  tree  T corresponding  to  a length  function  5 with  routing  Y we 
can  define  a new  length  function  which  assigns  to  points  t in  any  one  of 
the  two  possible  directions  the  length  6(t)  » d[f(t)J  where  f(t)  is  the 
flow  at  t corresponding  to  <S  and  T in  the  appropriate  direction.  The 
corresponding  routing  is  denoted  Y.  Note  that  if  Y is  singular  then  6 and 
Y depend  not  only  on  6 but  also  on  T.  If  Y is  regular  then  Y is  uniquely 
determined  by  6 . 

He  are  now  in  a position  to  define  an  algorithm  similar  to  the  one  of 
Section  3.  Given  a length  function  and  a corresponding  shortest  path 

tree  TQ  and  routing  YQ,  the  next  length  function  is  6^  • with  corresponding 

routing  Y^  - YQ.  A shortest  path  tree  corresponding  to  5^  is  selected 
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and  is  used  to  define  similarly  52»  Y2  and  • Similarly  the  algorithm 
generates  5^,  y^  and  for  all  k. 

We  say  that  a routing  Y*  corresponding  to  a length  function  6*  and 
shortest  path  tree  T*  is  an  equilibrium  routing  if  T*  ■ 6*  and  Y » Y*. 

Contrary  to  the  case  of  a ring  network  where  we  were  able  to  prove 
existence  of  an  equilibrium,  in  general  there  need  not  exist  an  equilibrium. 
This  fact  is  demonstrated  in  the  following  example  and  provides  an  indication 
of  the  complexity  of  the  dynamic  phenomena  that  we  are  investigating. 

Example?  Consider  the  network  shown  in  Figure  5. 


i 


Figure  5 

There  are  two  nodes  1 and  2 and  three  links  connecting  them  denoted  by 
A,B,C.  Node  2 is  the  destination.  Points  on  A,B,  and  C are  parameterized 

by  their  Euclidean  distance  to  the  destination.  The  Euclidean  lengths  of 
A,B  and  C are  all  taken  equal  to  unity.  Let  the  input  density  function  be 


as  follows 
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For  link  A:  r(t)  * l,  Yt€[0,l] 

For  link  B:  r(t)  * rB,  Yt€[0,l] 

For  link  C:  r(t)  ■ rc»  Yt€[0,l]. 

We  assume  that  l*rB*rc,  l<rc.  Let 

d(£)  - * + f 

where  «>0  is  the  bias  factor. 

In  view  of  the  fact  1 < r < r , l<r.,  it  is  clear  that  am  equilibrium 

••  B — C C 

routing  cannot  contain  a point  in  the  interior  of  link  A,  while  it  must 
contain  a point  in  the  interior  of  link  C.  We  consider  two  cases: 

Case  1:  r_  » 1.  Then  an  equilibrium  routing  cannot  contain  a point  in  the 
interior  of  link  B so  the  only  candidate  for  equilibrium  are  the  two  types 
of  singular  routings  shown  in  Figure  6.  In  routings  Y^  and  the  incoming 
traffic  at  node  1 is  routed  through  link  A and  link  B respectively.  None 
of  the  two  routings  can  be  an  equilibrium.  In  routing  Y^  there  will  be  points 
in  the  interior  of  link  A which  will  have  a shorter  distance  to  the  destination 
(.corresponding  to  Y^)  through  link  B rather  than  through  A,  and  the  reverse 
situation  occures  in  routing  Y^.  Notice  that  this  argument  makes  use  only 
of  the  magnitude  of  and  r^  and  is  independent  of  the  form  of  the  function  d. 

Case  2:  Kr^.  Then  it  can  be  seen  that  the  only  candidates  for  equilibria 


are  routings  of  the  form  shown  in  Figure  7 


i 
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specified  by  the  points  yB>  y^tO.iJ  where  the  flow  separates  on  links  B and 
C.  We  have  that  the  distances  D+(yg),  D* (yg)  of  yg  corresponding  to  routing 
(yB,yc)  along  the  counterclockwise  and  clockwise  paths  respectively  are  given 

by 

D~  <yB>  * % + rB  vt)dt 

+ ,l 

D (yB)  ■ (2  - yg)«  + r^j  (t  - yg)dt 

yB 

1 

+J  l*B<1  * yB*  + rC(l  " yC>  + C1  “ Oldt 

If  (yB,yc)  is  an  equilibrium  we  oust  have 

J>’(yB)  - d+ (yB) 

which  after  some  calculation  can  be  written  as 

rB  " 1 

(48)  2 («  + rg)  (1  - yB)  + rc (1  - yc>  -- 1 *—  . 

By  symmetry  the  equation  D*(yc)  * D+(y(,)  can  be  written  as 

rc‘ 1 

(49)  rB(1’yB)+2(ar  + rC)<1‘yC)*^  ZT  ' 


Equations  (48)  and  (49)  are  in  fact  necessary  and  sufficient  conditions  for 

<v  yc)  to  be  an  equilibrium  routing.  Thus  there  exists  an  equilibrium 

* ★. 

routing  if  and  only  if  the  solution  (y^y^,)  to  these-  equations  satisfies 
yg€[0,l],  y^€[0,l].  After  some  calculation,  this  condition  can  be  shown  to 
be  equivalent  to 


Routing  Y^  Routing  Yj 


Figure  6 


1 


7 

Figure  1 
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If  2r_  > r + 1 then  for  every  level  of  bias  there  exists  an  equilibrium  rout- 
ing  (y  , y ).  If  however  2r  < r + 1 then  there  exists  an  equilibrium  only 
for  a above  the  threshold  level  indicated  in  (50) . 

The  preceding  example  shows  that  existence  of  an  equilibrium  can  depend 
on  both  the  level  of  bias  and  the  input  density  function.  Furthermore,  it 
may  happen  that,  for  a given  input  density  function,  no  value  of  bias  can  be 
found  for  which  an  equilibrium  exists.  This  last  phenomenon  is  of  a singular 
nature  and  is  due  to  the  fact  that  the  Euclidean  lengths  of  links  A,B,  and  C 
are  all  equal  to  unity.  To  see  this  consider  the  routing  corresponding 
to  the  length  function  6+(t)  = 1,  6~(t)  = 1.  The  routing  Y^  is  analogous 
to  the  min- hop  routing  in  discrete  node  networks,  and  can  be  associated  with 
infinite  level  of  bias.  It  is  an  equilibrium  routing  for  the  case  d(f)  = 1. 

If  Y is  a regular  routing,  i.e.  each  node  has  a unique  minimum  Euclidean 
distance  path  to  the  destination,  then  it  is  clear  that,  for  any  given  input 
function  r,  there  exists  a threshold  level  of  bias  a such  that  for  all 
a >aa  regular  equilibrium  routing  exists. 

Characterizing  the  dynamic  behavior  of  the  algorithm  in  the  absence 
of  an  equilibrium  is  certainly  an  interesting  problem  but  we  have  been  un- 
able to  make  much  progress  in  this  direction.  Computational  results  for 
finite  node  networks  given  in  [3]  suggest  that  the  stability  properties  of 
the  algorithm  are  improved  by  high  level  of  bias  and  averaging  similarly 
as  in  the  presence  of  an  equilibrium.  In  what  follows  in  this  section  we 
restrict  attention  to  the  case  where  a regular  equilibrium  routing  exists. 

Given  a regular  equilibrium  routing  Y*  ■ {yf  y* , . . . ,y*}  consider 
for  j — 1,2, ...  ,n  the  link  (i^,S^)  containing  y*  and  the  two  shortest  paths 

from  yj  to  the  destination.  A simple  but  fundamental  observation  is  that 
these  two  paths  join  at  some  point  thereby  forming  a ring  of  the  type  con- 
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sidered  in  Section  3.  The  zero  point  on  this  ring  is  the  point  where  the  two 

* 

paths  join.  Let  e ^ be  the  Euclidean  length  of  the  ring  containing  y^.  For 

* 

j » 1,2, n we  parameterize  points  on  the  ring  containing  by  the  number  in 

I0,e^]  going  from  smaller  to  larger  numbers  as  we  traverse  the  ring  in  a chosen 

direction  similarly  as  in  the  previous  two  sections.  Thus  points  y^  on 

the  link  (ij ' > can  •“*  w111  identified  by  the  number  in  [0,e^]  specifying 

* ' 

their  position  on  the  ring  corresponding  to  y^.  It  is  easy  to  see  now  that 

given  Y*»  any  collection  Y » ^1^2' • • * ,yn^  such  that  yj  lieS  in  th®  interior 

of  (i  ,4.)  specifies  a flow  fy  through  each  point  in  the  network  that  follows 

the  (ordinary)  shortest  path  tree  corresponding  to  5 and  Y and  separates  on 

each  link  (i^.ij)  in  the  two  opposite  directions  at  the  point  y^ • This  flow 

defines  a length  function  5y  via  the  relation  6y(t)  » d[fy(t)]  in  the  direction 

of  the  flow,  and  6y  yields  in  the  manner  described  earlier  a shortest  path 

tree  and  a routing  denoted  by  g(Y).  It  is  easy  to  show  (using  the  regularity 

of  Y*)  that  if  Y is  sufficiently  close  to  Y*  then  the  (ordinary)  shortest  path 
* * 
tree  corresponding  to  6y  is  the  same  as  the  one  corresponding  to  Y and  that 

the  elements  of  the  routing  g(Y)  lie  on  the  links  (i^,f^). 

The  algorithm  described  earlier  can  now  be  redefined  as 

<5l>  Vi  ■ »<v- 

* 

The  definition  is  local  within  a sufficiently  small  neighborhood  of  Y and 

* 

is  associated  with  the  (ordinary)  shortest  path  tree  corresponding  to  Y 
and  the  associated  parameterization  of  the  ring  subnetworks  containing  the 
links  (ij,!j). 

Similarly  as  in  the  preceding  section  we  say  that  an  equilibrium 
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Y*  is  locally  stable  if  chare  is  a neighborhood  of  Y (defined  in  terms  of 
Che  parameterization  of  the  rings  associated  with  Y 48  discussed  earlier) , 
such  that  the  sequence  Cg(Yk;)  generated  by  (50)  is  well  defined  and  con- 
verges to  Y*  for  every  choice  of  Yq  within  this  neighborhood. 

In  order  for  Y*  to  be  locally  stable  it  is  sufficient  that  the 
],e  defined  and  have  all  its  eigenvalues  within  the  unit 


mm  matrix 


dY 


circle.  The  computation  of  ) is  straightforward  along  the  lines 

of  Section  3.  We  first  Introduce  some  notation.  For  j«l,2,...,n 

let  R*  denote  the  set  of  points  t€[y.,e.]  on  the  Jth  ring,  and  r" 

yj’aj  J J 7J’*J 

denote  the  set  of  points  t€[0»yj]  on  the  same  ring.  Note  that  for  every  • 

1,m«l,...,n  the  direction  of  flow  on  R*  and  R* 

7J*  J 7-’" 


and  R'  (or  R ) 
ym’am  ym**m 

coinside  if  these  sets  have  intersection  with  positive  Lebesgue  measure 


This  implies  that  at  least  one  of  the  sets  R*  ^R*  . and  R*  Hr* 

7;j'eJ  Va*  7j'*j  V ■ 

is  either  empty  or  has  Lebesgue  measure  zero.  Similarly  at  least  one  of 


the  sets 


Hr"  _ and  R~  Hr_  is  either  empty  or  has  Lebesgue 


R MR 

sure  zero.  The  equations  defining  g(Y)  can  be  written  as 


7J*aj  Vm 


J*_  d[f”(Y,t)]dt  • d[f+(Y,t)]dt,  j-1 n. 


R 


8jOO»«j 


‘gjOO.aj 


By  differentiation  with  respect  to  y we  obtain  similarly  as  earlier  at  the 


equilibrium  Y 


(51) 


*8«  Of  ) r(y*) 


£ 


2d  (0)  9Jm» 


where 
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r * . n r** 


d'[f+(Y*,t)]dt 


yj»ej 


yn,»*m 
01  WL 


"I-  . - d'[£'CY*,t)]dt 

R * Hr*  D 

yj‘ej  Ven 


+r+*  n r'* 

yj,ej  ym,em 


d' (f”(Y*,t)]dt 


+J*  d*  [f ^ (Y*,t)  Jdt 

r“*  n r+* 
yj’cj  Ve« 

and  f*(Y*,t) , f ” (Y*,t)  are  Che  flows  on  the  jth  ring  in  the  positive  and 
negative  directions.  In  view  of  the  preceding  discussion,  at  least  two  of 
the  integrals  in  (52)  ere  zero  for  every  j and  a. 

* 

Let  R be  the  diagonal  matrix  having  r(y^)  as  jth  diagonal  element, 
and  let  9 be  the  nxn  matrix  having  as  elements  the  scalars  ® . . Then  we  have 


3iOU  ■— L-9r 

3Y  2d(0)  K* 


We  can  show  that  the  matrix  9 is  negative  seaidefinlte.  indeed  the  matrix 
ia  the  Gram  matrix  associated  with  the  functions 


XR>  . (t)  d'  [ft (Y*,r)  ] 

Yj'j  3 


XR%  (t)  d*  [f’(y\t)]  , j-1 n. 


where  Xg  is  the  characteristic  function  of  a set  S (x  It)  • 1 if  tes , \(t)  ■ 0 

otherwise) . By  using  the  fact  that  R is  diagonal  it  can  be  shown  that  the  eigenvalue 

* 

\ of  are  real  and  nonpositive.  Consider  the  spectral  radius 

1 n 3Y 


f 1 
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U - m*x  {|X1| |Xn|}  . 

* 

Then  the  equilibrium  Y is  locally  stable  for 

(53)  y < 1, 

and  hence  there  exists  a threshold  level  for  d(0)  above  which  the  corresponding 
equilibrium  is  stable.  Similarly  as  in  the  preceding  section,  we  can  show 
that  if  a fading  memory  scheme  with  decay  factor  8 is  used  to  average  the 
effects  of  past  routings  the  equilibrium  Y is  locally  stable  if 

(54)  U < , 

and  there  is  a value  of  6 which  optimizes  the  rate  of  convergence.  It  is 
also  possible  to  show  that  the  other  forms  of  averaging  the  effects  of 
several  past  routings  improve  the  stability  properties  of  the  algorithm. 

For  the  purpose  of  aiding  the  reader  in  understanding  the  method  of 
calculation  of  the  matrix  we  provide  an  example. 

Pmwplas  Consider  the  network  shown  in  Figure  8 where  node  4 is  the 

destination,  and  assume  that  the  regular  routing 

an  equilibrium.  The  figure  shows  also  the  chosen 

* 

the  ring  corresponding  to  each  yi  . 


* • * 

ly1#  y2.  y3>  shown  in 
positive  direction  on 


Figure  3 


We  calculate  the  symmetric  matrix  9 with  elements  0 jB  given  by  (521 . 
The  interval  between  any  two  nodes  i and  l is  denoted  [i,X].  The  interval 
between  some  y*  and  a node  t is  denoted  [y*,X] . We  have 


>„  - - J*  d'tftorVn  dt  • J * d'[f“(Y*, 

&J.II  U [1,3]  UC3.4]  W 


tlJ  dt 


* * J * d'{f*(Y*,t:)]  dt  - P * d'lfjtt*, 

22  ty!.2lUt2.3]  2 [y2.i]  U [1,3]  2 


tn  dt 


®33  * ’ J' 


• * 


d'  [t£ (Y*,t)  I dt-J‘  * d,If3(Y  ,t)I  dt 


U [2,3]  U [3,4] 


[yv*l 


• u - - J d‘(f*(Y*,t)l  dt 
[1,31 

023  - " S d*[fJ<Y*,t)Ut 

[2,3] 
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0.  - - J d*[fI(Y*.t)]dt 

13  [3,4] 
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